Case Docket No. PHF 99,595 

COMMISSSONER'FOR PATENTS, Washington, D.C. 20231 

Enclosed for filing is the patent application of Inventor(s): 
RAOUbFLORENT LUCILE GOUBET 

For: IMAGE PROCESSING MEriJ£i^ySTEM AND APPARATUS FOR NOISE REDUCTION IN AN IMAfig 
SEQUENCE REPRESENTliPrrHREADLIKE STRUCTURE ' " ri^ 

ENCLOSED ARE.- 

rx] Associate Power of Attorney; n 
fx] Information Disclosure Statement, Form PTO-1449 and copies of documents listed therein; 
[X] Preliminary Amendment; 

[X] Specification (16 Pages of Specification, Claims, & Abstract); 
[X] Declaration and Power of Attorney: 

(2 Pages of a [ ]fully executed [X]unsigned Declaration); 
[X] Drawing (3 sheets of [ ]informal [XJformal sheets); 
[ ] Certified copy of application Serial No. ; 

[X] Authorization Pursuant to 37 CFR 1.136(a)(3) 
[X] Other: RELATED CASES; 
[ ] Assignment to 


FEE COMPUTATION 


CLAIMS AS FILED 

FOR 

NUMBER 
FILED 

NUMBER 
EXTRA 

RATE 

BASIC FEE 

$690.00 

Total Claims 

11- 20 = 

0 

X $18 

0.00 

Independent 
Claims 

1-3 

0 

X $80 

0.00 

Multiple Dependent Claims, if any $270 = 

0.00 

TOTAL FILING FEE 

$710.00 


Please charge Deposit Account No. 14-1270 in the amount of the total filing fee indicated 
above, plus any deficiencies. The Commissioner is also hereby authorized to charge any 
other fees which may be required, except the Issue fee, or credit any overpayment to 
Account No. 14-1270. 


[ ] Amend the specification by inserting before thg fii 
of application Serial No. , filed 



e sentence: This is a continuation-in-part 

A/'" 


CERTIFICATE OF MAILING , , ^ 

[X ] Express Mail Mailing Label No. ^Ui\^j%^fj j 
of Deposit 


Jol^ F. Vodopia, Reg. 36,299 
Attorney 
914-333-9627 


Date 


1 hereby certify tiiat this paper and fee is being deposited with the 
United States Postal Service "Express Mail Post Office to Addressee" 
service under 37 CFR 1 .10 on the date indicated above and is addressed 
to the Commissioner for Patents, Washington, D.C. ^Q2yr\ 


Name Signature 


Name Signature 
Send correspondence and papers to Corporate Patent Counsel 
U.S. Philips Corporation, 580 White Plains Road, Tarrytown, New York 10591 

F:\WPDOCS\vo\phf99595 .app.doc 


IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 
In re AppMcation o'f ' Atty' Docfcet 

RAOUL FLORENT et al. PHF 99,595 

Filed: CONCURRENTLY 

IMAGE PROCESSING METHOD, SYSTEM AND APPARATUS FOR NOISE REDUCTION 
IN AN IMAGE SEQUENCE REPRESENTING A THREADLIKE STRUCTURE 

Commissioner for Patents, Washington, D.C. 20231 


PRELIMINARY AMENDMENT 

Sir: 

Prior to calculation of the filing fee and examination, pleas 
amend the above-identified application as follows: 


IN THE SPECIFICATION 
Page 1, before line 1, insert the following heading: 
--BACKGROUND OF THE INVENTION--; 
before line 9, insert the following heading: 

--SUMMARY OF THE INVENTION--; 
line 22, change "It results that" to — By use of the 
method, — ; 

line 25, change "provides" to — provide — ; 
Page 2, line 11, change "to operate" to --direct--; 

line 12, delete "the propagation of"; change "for a" to 
— thereby--; delete "to be made to"; 
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line 19, change "as claimed in Claim 1." to — for noise 
' filtering an image sequence representing a 
threadlike structure on a background, including 
an acquisition of point data in first and 
second sequence images and an estimation of the 
corresponding filtered point data for 
constructing a filtered second image, the point 
data being the intensities associated to co- 
ordinates of image points, said method 
comprising, performed in each sequence image, 
steps of: extracting the threadlike structure 
points, forming strings from said extracted 
points, temporally filtering the data of the 
points located outside the strings denoted 
background points, spatially filtering the data 
of the string points, and constructing the 
filtered second image data by performing an 
insertion of the spatially filtered data of the 
string points into the temporally filtered data 
of the background points.--; 

line 22, change "is further claims in claim 11" to 
— includes a computer program product 
comprising a set of instruction for carrying 
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out a method as claimed in claim 1--; 

line 23, ' chahge "is " to — as claimed in claim 6, 

including an enhancement operation performed on 
spatially filtered string point data, 
comprising steps of: selecting string points 
[A(i,j)] using the list of the control signal 
[St(i,j)], enhancing the string point data with 
respect to their local environment, and 
constructing a filtered second image data by 
performing an insertion of the enhanced 
spatially filtered data of the string points 
into the temporally filtered data of the 
background points, controlled by the binary 
control signal--; 

line 24, delete "claimed in claim 12; 

before line 27, insert the following heading: 

--BRIEF DESCRIPTION OF THE DRAWINGS--; 

line 30, after "background;" begin a new paragraph; 

line 31, after "operation;" begin a new paragraph; 

line 32, after "branches;" begin a new paragraph; 
Page 3, line 2, after "1" insert --;-- (semicolon); and after 
"and" (2nd occurrence) begin a new paragraph; 

line 22, change "denoted" to --denoting--; 
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between lines 30 and 31, insert the following heading: 
' — DESCRIPTION OF THE PREFERRED EMBODIMENTS-- 
and 

Page 4, line 18, delete "of"; 

Page 5, line 31, after "point" (last occurrence) insert --or- 
IN THE CLAIMS 

Please amend claims 1, 7, 8, 9 10 and 11 as follows: 

Claim 1, line 7, after "points," began a new paragraph; 

line 8, after "points, (1st occurrence) begin a new 
paragraph; 

line 9, after "points," (1st occurrence) being a new 
paragraph , 

Claim 7, line 1, change "Claims 5 or 5" to --claim 5--. 

Claim 8, line 1, change "one of the preceding Claims" to 
— claim 1 — . 

Claim 9, line 3, change "any of Claims 1 to 8" to --claim 1-- 
Claim 10, line 2, after "9" insert — , -- (comma). 
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Claim 11, line 1, ' chahge "instruction" to ' — instructions — ; 

line 2, change "one of claims 1 to 8" to — claim 1 — . 

Please add the following new claim 12: 

12. A method as claimed in claim G, including an enhancement 
operation performed on spatially filtered string point data, 
comprising steps of : 

selecting string points [A(i,j)] using the list of the control 
signal [St(i,j)], 

enhancing the string point data with respect to their local 
environment, 

and constructing a filtered second image data by performing an 
insertion of the enhanced spatially filtered data of the string 
points into the temporally filtered data of the background points, 
controlled by the binary control signal. 

IN THE ABSTRACT 

Page 16, before line 1, delete in its entirety and substitute the 
following heading: --ABSTRACT OF THE DISCLOSURE--; 
line 4, change "image said method comprising," to 
— image. The method is--; 
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line 5, change steps of." to — and includes — ; 
line 6, ' continue on previous line; 

change "said" to --the--; 
line 9, continue on previous line; 
lines 12-15; delete in their entirety. 


This Preliminary Amendment is submitted to place the 
application in proper U.S. format. Entry is respectfully 
requested . 


REMARKS 


Respectfully submitted. 



Edward W. Goodm^ 
Attorney 
(914) 333-9611 
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Image processing method, system and apparatus for noise reduction in an image sequence 
representing a threadlike' structure 


The invention relates to an image processing method for noise reduction in a 
sequence of noisy images representing a threadlike structure on a background. The invention 
particularly relates to noise reduction method applied to a sequence of medical X-ray 
fluoroscopy images representing a catheter guide-wire. The invention also relates to a system 
5 for carrying out this method and to an examination apparatus having means for image 
processing. The invention is applied to the medical imaging. 

An image processing system for filtering X-ray fluoroscopic image sequence 
10 is already known of a US patent N°5809105. This document discloses means for acquiring 
one image by passing X-rays through a subject, said image comprising an array of pixel 
values, means for receiving the image and producing a mask therefrom which distinguishes 
the pixel values that correspond to structural features in the image from the pixel values that 
correspond to background and means being responsive to the mask for selectively filtering 
15 the pixel values in the image that correspond to background. The means for filtering the 

background pixel values include a Poisson filter which is spatial filter. So, the mask is used to 
select the background pixels for filtering the background noise while enabling the structural 
pixels to pass unfiltered to the display. 

20 

This known method does not provide means to detect object motion in an 
image sequence. It results that it may be difficult to filter the background by applying the 
mask without degradation of said structural features, especially if they represent a very thin 
threadlike structure. The mask may cover up said threadlike structure when a non-detected 
25 swift motion occurs. Besides, this known method does not provides means to eliminate 
phantom artifacts. Furthermore, this known method does not provide means for noise 
filtering the object pixels themselves. This is a drawback because the boundaries of a thin 
threadlike structure may be blurred by noise, which makes said threadlike structure difficult 
to localize, whereas the central points of the threadlike structure may be sputtering due to 
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noise, which makes this threadUke structure difficult to visualize, even when the background 
has been noise filtered. Moreover, the known method does not permit enhancement of the 
structural features with respect to the background. This is a drawback when the thin 
threadlike structure presents little contrast with respect to a noisy cluttered background. 

5 In cardiology, a sequence of images may be formed of images representing 

blood vessels called arteriogram images used to visualize in real time medical procedures of 
introducing a catheter in a vessel. Such medical procedures deeply rely on the correct 
visibility of a metallic guide-wire, which is introduced in the vessel for guiding the catheter. 
These fluoroscopic digital images are noisy because they are formed with a low level of X- 

10 rays. It is very important to improve considerably the guide-wire visualization in image 

sequences formed in the X-ray fluoroscopic mode in order to help the practitioner to operate 
the propagation of the catheter in the arteries for avoiding damage to be made to said arteries 
during this operation. 

The invention aims at providing an image processing method to be applied to a 

1 5 noisy image sequence representing a threadlike structure on a background, at improving the 
background noise reduction without degradation of said threadlike structure, at eliminating 
the phantom artifacts and at noise filtering and enhancing the threadlike structure in real time, 
for example at a rate of about 25 images per second. 

These aims are reached by an image processing method as claimed in Claim 1. 

20 Advantages of this method are that the object of interest localization is much 

more accurate, while the processing method is carried out in real time. 

A system to carry out said method is further claimed in claim 11, and an 
examination apparatus with a system and means for carrying out the processing method is 
claimed in claim 12. 

25 

The invention is described thereafter in detail in reference to diagrammatic 
figures, wherein : 

FIG.l is a functional block diagram illustrating the steps of the method ; 
30 FIG.2A shows an original image of a guide- wire on a background; FIG.2B 

shows an image of guide-wire extracted pixels supplied by the OWE operation; FIG.2C 
shows an image of strings with branches; FIG.2D shows an image of an independent string; 

FIG.3 illustrate the step of local enhancement of the string point intensities; 
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FIG.4A is a functional block diagram illustrating an examination apparatus 
having a system and mdans fo'r carrying out the method of FIG. 1 and FIG.4B illustrates an X- 
ray apparatus for providing image data to a processing system. 

The invention relates to an image processing method for noise filtering an 
image sequence representing a threadlike structure, possibly moving on a background, 
including an acquisition of the point data in first and second sequence images and an 
estimation of the corresponding filtered point data to reconstruct a noise filtered second 
image. By threadlike structure, one understands an elongated shaped object, having a 
transversal dimension of 1 to 10 pixels, possibly 1 to 3 pixels, in a digital image. The point 
data are the intensities and co-ordinates of the points in the images. 

In an example described hereafter, the invention particularly relates to a noise 
reduction method applied to a sequence of medical X-ray fluoroscopic noisy images 
representing a threadlike structure that is a catheter guide-wire on a cluttered background. 
The image processing method aims at reconstructing an improved sequence of images where 
the point intensities of the guide-wire are noise filtered and enhanced with respect to a 
filtered background. One problem lies in the selection of the points that must be both filtered 
and enhanced as guide-wire points, or that must be filtered as background points, in the 
sequence images. This problem is solved by an image processing method comprising steps of 
extracting the guide-wire points, forming strings from said extracted guide-wire points, 
temporally filtering the points located outside the strings, denoted background points, 
spatially filtering the points located on the strings denoted guide-wire points and inserting the 
spatially filtered guide-wire points in the image of the temporally filtered background points. 
An other problem lies in the elimination of phantom artifacts. This problem is solved by 
processing a sequence of two images and by selecting for insertion the guide- wire points that 
have been located on a string in at least one of the two images. An other problem lies in the 
lack of contrast of the original images. This problem is solved by applying local intensity 
enhancement on the spatially filtered guide-wire string points and inserting the resulting 
enhanced guide- wire string points in the image of the temporally filtered background points. 
Referring to FIG.l, the method comprises the main operations of: 
acquisition 100 of digital intensity signals Xt-1 or Xt of an arteriogram image 
representing a guide-wire GW on a background BG, as shown in FIG. 2 A; 
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extraction 10 of the guide-wire points from the arteriogram image, meaning 
detection and location of the guide- wire points, providing a b'inary signal Mt-1, Mt of 
detected guide-wire points associated to their co-ordinates i, j, as shown in FIG.2B; 

string formation 90 from the extracted guide-wire points for providing a string 
5 signal St(i, j) of numbered string points, with their co-ordinates i, j, as shown in FIG.2C; 

insertion 40 of spatially noise filtered guide- wire intensities of points located 
on the strings in an image of temporally recursive noise filtered intensities of points not 
located on the strings, referred to as background points; 

spatial filtering 60 of the intensities of the numbered guide-wire points located 
10 on the strings, considered as temporal samples; 

local enhancement 70 of the spatially filtered guide-wire string point 

intensities; 

and insertion 80 of the enhanced spatially filtered guide-wire point intensities 
located on the strings in the already temporally filtered background image for providing final 
1 5 filtered samples denoted OUFt representing the final filtered image. 

This method also comprises a step 50 of elimination of phantom artifacts, 
which is performed using two successive arteriogram images in a sequence. The use of two 
images also permits of performing temporally recursive filtering for noise filtering the 
background. 

20 As described in more detail hereafter, the following method is preferably 

carried out using two successive images of an image sequence, including a first image 
referred to as causal image acquired at a first instant t-1, and a second image referred to as 
present image acquired at a second instant t. This method performs the processing of the 
image points according to a standard scanning of the images so as to filter each current point 

25 one after the other. The co-ordinates of the current point in the images are denoted i, j and the 
intensity values, referred to as samples, at this location i, j in the causal and present original 
images, are respectively denoted Xt-1, Xt. This method is performed in real time, that is to 
say at a rate of about 25 images per second. 

In this image processing method, the filtering of the background is preferably 

30 carried out using a temporal recursive adaptive filter. Temporal filters are generally known as 
giving the best filtering results in image sequences representing objects without motion. In 
image sequences representing objects with motion, temporal recursive filter that are made 
adaptive to motion may be used. However, in that case, complete moving-detail preservation 
is virtually impossible. So, using a temporal recursive filter in an image sequence comprising 
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a moving object as thin as said guide-wire may expose so thin a structure to some amount of 
degradation. In fact, a temporal recursive filter relies 6n pixei-wise fuzzy decisions regarding 
the motion occurrence between consecutive images. Since these decisions are fuzzy and since 
X-ray fluoroscopic images are usually very noisy, a temporal filter fails to completely 
5 preserve weakly contrasted moving objects because it fails to reach certainty about the 

occurrence of motion. It is the reason why, according to the present method, the guide-wire 
points are extracted and then these guide-wire points are not temporally filtered. Instead, the 
extracted guide-wire points are processed in order to be spatially filtered. 

In reference to FIG.2A, the guide-wire points are extracted in one image at a 

10 time, on a purely spatial basis, that is, regardless of its motion content. To that end, each 

original image is first scanned in order to determine whether the current point pertains to the 
image background BG or to the guide-wire GW. Then each guide-wire point is extracted. In 
reference to FIG.2B, based on the extracted points, strings of points are formed in order to 
eliminate guide-wire boundary points and to keep guide- wire central points for further 

15 processing, in reference to FIG.l, a recursive temporal filtering RTPF is applied to those 

points that are not extracted as string points and thus are denoted background points, whereas 
a spatial filtering SPFl is applied to those points that are extracted as guide-wire string 
points. So, at a string point location, which is a guide-wire point location, as the probability 
of movement is high, no temporal filtering is performed; instead, a spatial filtering is 

20 performed; whereas, at a non-string point location, which is regarded as a background point 
location, as the probability of movement is low, temporal filtering is allowed to be 
performed. FIG.l shows diagrammatically the detailed steps of the processing method for 
noise reduction in the images of a sequence representing a moving guide- wire as described 
above. This method provides a final filtered sample denoted OUFt relative to each current 

25 point at a location i, j for reconstructing a filtered image at time t from the samples Xt-1, Xt 
of the causal and present images. These detailed steps are : 

acquisition 100 of the samples Xt-1, Xt of the current point located at the co- 
ordinates i, j respectively in the causal and present images of the sequence; 

guide- wire extraction 10 performed by an extraction module denoted GWE 

30 receiving at its input 1 said samples Xt-1, Xt, and providing at its output 56 respective binary 
samples Mt-1, Mt, which are either a data 1 for a current point that is a guide- wire point a 
data 0 for a current point that is not a guide-wire point, thus is regarded as a background 
point; associated to the binary data values Mt-1, Mt related to points, are the co-ordinates i,j 
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of said points; this provides an image denoted IMt of the guide-wire points of intensity 1 
represented on a background of intensity zero, at the ihstant t, as shown in nG.2B; 

string formation 90, which transforms the image DVIt of the extracted guide- 
wire points into strings of chained points also referred to as connected points; a string point 
5 pertains to a set of connected points, so as each string point has two connected neighbors, 
except the two end points of the string, which have each only one neighbor; the step of string 
formation 90 may provide several strings or strings having several branches, for example Bl, 
B2, B3.... as represented on FIG.2C; in that last case, the points that are common to several 
branches are called multiple-points and have to be detected using an operation of point 

10 detection known of those skilled in the art; this operation of point detection is followed by an 
operation of branch separation at the location of the multiple-points and evaluation of the 
most probable strings denoted SWS; FIG.2D shows an example of such an image, denoted 
ISt, at the instant t; the output 91 of the string module 90 supplies a list St(i, j) of connected 
points characterized by point running numbers 1, 2,..k,..n on the string SWS and by the co- 

15 ordinates i, j of said string point in the image ISt, such as : il,jl; i2,j2; ...; ik,jk;... in,jn; the 
string formation step may be carried out using morphological filters performing a thinning 
operation providing structures denoted skeletons of extracted points; then, these skeletons are 
the base of constitution of the string SWS; 

spatial filtering 20 performed by a purely spatial filter module denoted SPFl, 

20 which receives at its input 2 the sample Xt of the present image, and provides at its output 
40B a spatially filtered sample referred to as gate sample denoted Gt; this spatial filtering 
operation is not compulsory : the original signal Xt may be used directly in the further step 
40 instead of the gate signal Gt because spatial filtering will be performed in further steps of 
the image processing method; however said spatial filtering operation 20 is recommended in 

25 order to smooth the sample Xt, which in every case improves said method; 

temporal filtering 30 performed by a temporal recursive filter module denoted 
TPRF, which receives at its input 4 said samples Xt-1, Xt of the causal and present images, 
and provides at its output 40A a temporally filtered sample denoted Yt. This temporal filter is 
connected to a loop 49 providing a delay A, which receives at its input 40A the filtered 

30 sample Yt and supplies at its output 47 a stored causal sample Yt-1 for the temporal filter 
TPRF to perform a recursive temporal filtering. 

The string formation operation provides several advantages : The guide-wire is 
replaced by a string structure meaning that the blurred boundary points are now eliminated 
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and that only guide-wire central points are processed. This operation also provides the list 
signal St(i,j) which is a'control signal for the construction of the further filtered images. 

The operations of string formation, spatial filtering and temporal filtering are 
performed in parallel. In an example of realization, the extracting module 10 denoted GWE, 
5 which performs the guide- wire point extraction, may comprise means or steps as those 
described in the EP0840252. The purely spatial filter 20 denoted SPFl, which provides the 
gate signal Gt from the original signal Xt, may be a spatial FMH (FIR-Median-Hybrid) filter 
such as described for example in the EP0755023. Such FMH filters show a good preserving 
ability for thin structures. A temporal recursive filter which can adapt itself to intensity 
10 discontinuities due to motion or noise peaks is already known, for example, of EP0751482. 
Such a filter is well adapted to be used in the present method. 

Now, the processing method further comprises an insertion step 40 performed 
by a module denoted INSERTION 1, which issues at its output 40C, a signal Zt(i,j) that 
depends on the location of the current point; said output signal Zt(i,j) is: 
15 either the gate sample Gt(i, j), supplied by the spatial filter module SPFl to the 

INSERTION 1 module input 40B, when the current point is determined as a string point by a 
signal control that is present at an input 40L of the INSERTION 1 module; in that case, the 
current point is in the list St(i,j) at said location i, j at the present time t, 

or the temporally filtered sample Yt(i,j), supplied by the temporal filter TPRF 
20 to INSERTION 1 module input 40A, when the current point is determined as a non-string 

point by the signal control at the input 40L of INSERTION 1 module; in that case, the current 
point is not in the list St(i,j) at said location i,j at said present time t and is regarded as a 
background point. 

The list signal St(i,j) is a binary control signal 1 or 0 applied to the input 40L 
25 of the INSERTION 1 module 40. So, the INSERTION 1 module 40 inserts the intensities of 
the gate samples Gt at the locations i,j of the current points that are in the list St(i,j) of guide- 
wire string points, and inserts the intensities of the temporally filtered samples Yt at the 
locations i,j of the current points that are not in the list St(i,j) and that are non-string points, i. 
e. background points. In a general manner, the INSERTION 1 module 40 inserts the intensity 
30 image of the strings into the temporally filtered intensity image of the background. 

The binary control signal at node 40L is provided by the binary output data of 
the string formation module 90 modified by a module 50 denoted PHE devised for 
eliminating phantom artifacts. The PHE module receives the binary string signals St-1, St at 
the node 56. The causal binary signal St-1, which is received first, is stored in a memory or a 
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delay 51 of the PHE module so as said causal sample St-1 may be available at node 58 at the 
present instant t at the same time as the present binary signal' St is available at node 55. Then, 
nodes 55 and 58 constitutes the inputs of a logic OR 52 which delivers at the output 40L a 
binary signal equal to 1 every time that at least one of its inputs is equal to 1, or a binary 
5 signal equal to 0 only when both its inputs are equal to 0. This means that the output 40L of 
the PHE module 50 delivers a signal 0 corresponding to the presence of a non-string point, 
referred to as background point, uniquely when both causal and present binary signals St-1, 
St are themselves equal to 0, or a signal 1 corresponding to the presence of a guide-wire 
string point at the location i, j in all other cases, that is when at least one of the two binary 
10 samples St-1 and St is equal to 1 corresponding to the actual presence of a string point at the 
location i, j in at least one of the two images, the other image actually showing a non-string 
point, called background point. 

The output 40L of the PHE module 50 constitutes the binary control signal of 
the INSERTION 1 module 40, which selects the gate sample Gt for further image processing 
15 when the PHE module outputs 1 corresponding to the actual presence of a string point 

whether in both the causal and present images or in only one of said images, or which selects 
the temporally filtered sample Yt(i,j) for further image processing uniquely when the PHE 
module issues a signal 0 corresponding to the actual presence of non-string point, called 
background point, in both said images. Thus, the temporal filter is not allowed to provide a 
20 filtered sample Yt(i,j) which is a smoothed combination of intensities at location i, j of 
samples at instants t-1 and t corresponding respectively to a non-string sample, denoted 
background sample, and to a string sample. It results that a string point which is present in i,j 
at the causal instant t-1 and which is no more present at the instant t is not allowed to show 
through the image reconstructed at the present instant t since the temporal filter is only 
25 allowed to provide filtered samples corresponding to non-string points, denoted background 
points. So, spatially filtered intensities Gt(i,j), which are spatially filtered images of string 
points at the instant t, are inserted onto the phantom points, which were string points at 
instant t-1, whereas spatially filtered intensities Gt(i,j), which are spatially filtered images of 
string points at the instant t, are inserted uniquely at the location of corresponding string 
30 points. The phantom artifacts due to temporal filtering are eliminated. Only spatially filtered 
images of guide-wire points, located on strings, are allowed to be inserted in the temporally 
filtered images of background points. The INSERTION 1 module 40 supplies at its output 
40C the appropriate filtered sample Gt(i,j) or Yt(i,j) for forming the image signal Zt(i,j). 
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The insertion operation 40 provides several advantages : In the temporal 
recursive process, the points belonging to the moving guide-wire at time t, which might have 
been partly impaired, are fruitfully replaced by their spatially filtered counterparts. Also in 
the temporal recursive process, the points corresponding to the locations that the moving 
5 guide- wire occupied in the previous image, at time t-1, which might have been corrupted by 
phantom artifacts, consisting in that the guide- wire points at time t-1 shows through the 
image at time t, are fruitfully replaced by their spatially filtered counterparts. The quantum 
noise of the background is reduced. 

Now, the processing method comprises steps for noise filtering and enhancing 

10 the intensity of the guide- wire string points. For carrying out these steps, it is important to 
note that the list St(i,j) is used as a control signal to select the string points in the processed 
images. Referring to FIG.l, these further processing steps are : 

spatial filtering 60 performed on the image signal Zt(i,j) using a spatial filter 
module SPF2, which receives the image sample Zt(i,j) at its input 40C, the string signal 

15 St(i,j), giving the co-ordinates i,j of the string points, at its control input 75 and which 

performs spatial filtering on the points belonging uniquely to the strings, string by string. In 
fact, the guide-wire string point intensities in the image Zt(i,j) may be regarded as forming a 
temporal intensity signal denoted Ht(i,j) constituted of the samples Gt(i,j) considered 
between the start point corresponding to the first end point numbered 1 of the string SWS and 

20 the terminal point corresponding to the second end point numbered n of said string. Said 

temporal intensity signal Ht(i,j) propagates from the start point to the end point. Each sample 
Gt(i,j) of a guide-wire string has a number on said string, which is given by the string signal 
St(i,j) and which is similar to a time co-ordinate in a standard temporal intensity signal. So, a 
recursive temporal filtering technique can be applied to the samples Gt(i,j) of the strings in 

25 the image Zt(i,j) in the same way as to a standard temporal intensity signal. To that end, the 
guide-wire string points are scanned along the string according to their point number on said 
string, which is delivered by the string signal St(i,j) together with their co-ordinates in the 
image. The string point intensity is spatially filtered one point after the other in a causal 
direction, for example from the start point to the terminal point. Then said string point 

30 intensity can be further spatially filtered one point after the other in an anti-causal direction, 
for example from the terminal point to the start point in order to provide a recursive filtering 
with two passes, as in a temporal filtering technique. It has been found that two such passes 
in a causal and anti-causal direction provide a good noise filtering of the string point 
intensities in the Zt(i,j) image signal. The SPF2 module issues a noise filtered image signal 
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Ut(i,j) at its output 61, which comprises the spatially filtered string point intensities denoted 
Ht(i,j) and the background temporally filtered intensities Yt(r,j). The guide-wire represented 
by said filtered string point intensities shows no more boundaries with unpleasant sputtering 
and is agreeably noise filtered with elimination of noise peaks. 
5 To improve the visualization of the guide-wire in the difficult fluoroscopic 

images, the contrast of the guide-wire string point is further enhanced with respect to the 
background using an enhancement module 70 that receives the image signal Ut(i,j) with the 
noise filtered string point intensities Ht(i,j) at its input 61 and the string signal St(i,j) at its 
control input 91. This enhancement step 70 comprises operations of : 

10 determination 71a local neighborhood denoted V related to each point of a 

string, using a computation module denoted LN, which receives the string signal St(i,j) at its 
control input 76. As illustrated by FIG.3, a point A(ik,jk) of the string SWS is localized by its 
co-ordinates ik, jk given by the string signal St(i,j). Related to the string point A(ik,jk), a 
neighborhood Vk is determined; to that end the string direction is first evaluated by a mean 

15 value of the directions of said string SWS. Then the orthogonal direction SWO is evaluated 
from the string direction and the coordinates of about 3 points each side of the string SWS on 
said orthogonal direction SWO are determined, forming said neighborhood Vk; 

estimation 72 of the local contrast at the point A(ik, jk) using a computation 
module denoted LC, which has an input 79 for the Vk neighborhood, an input 81 for the 

20 image signal Ut(i,j) and a control input 77 for the string signal St(i,j)t; as illustrated by FIG.3, 
a mean value of the intensities of the neighborhood points in Vk, which are non-string points 
and thus are background points, is estimated from the Ut(i,j) signal and denoted U(Vk); the 
intensity of the given point A(ik, jk), which is a string point, is estimated from Ut(i,j) and 
denoted Ut(ik,jk); the local contrast LC(ik,jk) is computed as the difference between the 

25 mean intensity on the neighborhood Vk and the intensity at the string point A(ik,jk) : 
LC(ikJk) - U(Vk) - U(ik,jk) (1 ) 

amplification 73 of said local contrast LC(ik,jk) by a predetermined factor 
C>1, using a multiplier module 73, which receives the local contrast LC(ik,jk) and which 
issues a signal Ft(ik,jk) related to said string point A(ik, jk) : 

30 C. LC(ik,jk) = C X U(Vk) - C x U(ik,jk) (2) 

C. LC(ik,jk) = U(Vk) - Ft(ik,jk) (3) 
The signal Ft(ik,jk) is an enhanced intensity signal to be applied on the already spatially 
filtered string point A(ik,jk), whose calculation is based on the equations (2) and (3) : 
Ft(ik,jk) = [C X U(ik,jk)] - [(C - 1) X U(Vk)] (4) 
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Now, the enhanced string point intensity signal, denoted Ft(i,j), is calculated 
for all the points of the string SWS using formula (4) and is inserted into the image signal 
Ut(i,j) at the coordinates of the string points given by the string signal St(i,j). This operation 
is performed by a module 80, denoted INSERTION 2, which receives the image signal Ut(i,j) 
5 at its input 80 A, the enhanced string point signal Ft(i,j) at its input SOB and the control signal 
St(i,j), which is the string signal, at its control input 80L. The INSERTION 2 module 80 
performs said insertion operation for issuing at its output 80C, a signal OUFt(i,j) that depends 
on the location of the current point, which is : 

either the enhanced spatially filtered sample Ft(i,j) related uniquely to string 
10 point intensities, supplied by the enhancement module 70 to the INSERTION 2 module 80 at 
its input 80B, when the current point is determined a string point of the list St(i,j) at said 
location i, j at the present time t, by said control signal applied at its input 80L : 
OUFt(i,j) = Ft(i,j) = [C X U(i,j)] - [(C - 1) X U(V)] (5a) 
or OUFt(i,j) = Ft(i,j) = C.LC(i,j) - U(V)] (5b) 

15 or the temporally filtered sample Yt(i,j), supplied by the INSERTION 1 

module 40 to the INSERTION 2 module 80 at its input 80A, when the current point is 
determined as a non-string point by the control signal at the input SOL; the current point is 
not in the list St(i,j) and is considered as a background point at said location i,j at said present 
time t. 

20 OUFt(i,j) = Yt(i,j) (6) 

So, the INSERTION 2 module inserts the enhanced spatially filtered 
intensities of the string points into the temporally filtered intensities of the background, 
which means that the insertion module inserts the spatially filtered image of the strings into 
the temporally filtered image of the background. This INSERTION 2 module issues an image 

25 signal OUFt(i,j) at its output 80C, which constructs at the instant t the final filtered image. 

In a variant of the method, the strings may be 2 or 3 points width instead of 
purely one point width as described above. In this case, the operations above-described for 
the one point- wide string are applied on all points constituting the several point- wide strings. 
In any case, the string structure looks like a regular ribbon instead of the original irregular 

30 threadlike structure that is the original image of the guide-wire above-described as example. 

Referring to FIG.4A, image data of an image sequence, provided for instance 
by a medical examination apparatus 150, is further provided to an image processing system 
120 for processing the data according to the above-cited method. This image processing 
system 120 may be a suitably programmed computer, a processor of a workstation 130, or a 
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special purpose processor having circuit means such as LUTs, Memories, Filters, Logic 
Operators, that are arranged to perform the functions Of the method steps according to the 
invention. The workstation 130 may also comprise a keyboard 131, a screen 140 and a mouse 
132. The processing system may be connected to storing means to store the medical images. 

Referring to FIG.4B, an X-ray medical examination apparatus 150 comprises 
means for acquiring digital medical image data of a sequence of images at least comprising a 
causal and a present images, and a digital processing system 120 for processing these data 
according to the processing method described above. The X-ray apparatus comprises an X- 
ray source 101, a table 102 for receiving a patient to be examined, an optical system 103, 104 
for providing image data to the processing system 120 which has at least one output 106 to 
provide image data to display and/or storage means 107. The display and storage means may 
respectively be the screen 140 and the memory of a workstation 130 as described in relation 
to FIG.4A. Said storing means may be alternately external storing means. 
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CLAIMS: 


1 . An image processing method for noise filtering an image sequence 
representing a threadlike structure on a background, including an acquisition of point data in 
first and second sequence images and an estimation of the corresponding filtered point data 
for constructing a filtered second image, the point data being the intensities associated to co- 
ordinates of image points, said method comprising, performed in each sequence image, steps 
of: 

extracting the threadlike structure points, forming strings from said extracted 
points, temporally filtering the data of the points located outside the strings denoted 
background points, spatially filtering the data of the string points, 

and constructing the filtered second image data by performing an insertion of 
the spatially filtered data of the string points into the temporally filtered data of the 
background points. 

2. A method as claimed in Claim 1, comprising steps of : 

based on the string formation performed in said sequence images, providing a 
binary control signal [St(i,j)] formed of a list of the string points with their running number 
on the strings and their co-ordinates in the processed image, which determines whether the 
current point is a string point or a non-string point regarded as a background point. 

3. A method as claimed in Claim 2, comprising, for constructing the filtered 
second image, steps of : 

supplying said binary control signal (St(i,j)) for controlling the insertion of the 
spatially filtered data of the string points into the temporally filtered data of the background 
points. 

4. A method as claimed in Claim 3, comprising, for eliminating phantom artifacts 
due to temporal filtering of the background data, steps of : 

delivering the binary control signal [St(i,j)] for controlling the insertion 
operation through a logic OR operation, whose inputs are the first and the second control 
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binary signals related to the first and the second sequence images, said OR operation 
triggering the spatially filtered data when at least one 6f the two binary control signals 
corresponds to a string point. 

5 5. A method as claimed in Claim 4, including a spatial filtering operation 

performed on string point data, comprising steps of : 

selecting string points [A(i,j)] using the list of the control signal [St(i,j)], 
propagating on one string from its start point to its end point, according to the 

running number on the string, 
10 while propagating, performing a spatial filtering on each point of the string in 

a causal then in an anti-causal direction as using a temporal filtering technique, 

and constructing a filtered second image data by performing an insertion of the 

spatially filtered data of the string points into the temporally filtered data of the background 

points, controlled by the binary control signal. 

15 

6. A method as claimed in Claim 5, comprising for enhancing the string point 

data, steps of : 

selecting of a string point [A(i,j)] using the list of the control signal [St(i,j)], 
said string point having a spatially filtered intensity [U(i,j)], forming a neighborhood (V) for 
20 said string point using background points having temporally filtered intensities and 
estimating a mean temporally filtered intensity in said neighborhood [U(V)]; 

estimating the local contrast [LC(i,j)] related to said string point as a 
difference between said mean intensity in said neighborhood and the intensity of said string 
point and multiplying said contrast by a factor (C) for providing an enhanced contrast 
25 [C.LC(i,j)]; 

and calculating the enhanced string point intensity [Ft(i,j)] as the difference 
between the enhanced contrast and the mean intensity [U(V)] in the neighborhood (V) of said 
point. 

30 7. A method as claimed in one of Claims 5 or 6, including an enhancement 

operation performed on spatially filtered string point data, comprising steps of : 

selecting string points [A(i,j)] using the list of the control signal [St(i,j)], 
enhancing the string point data with respect to their local environment. 
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and constructing a filtered second image data by performing an insertion of the 
enhanced spatially filtered data of the string points into the temporally filtered data of the 
background points, controlled by the binary control signal. 

5 8. A method as claimed in one of the preceding Claims, wherein the 

images are medical examination digital images and the threadlike structure is a catheter 
guide-wire. 

9. A system comprising a suitably programmed computer of a workstation or a 
10 special purpose processor having circuit means, which are arranged to process image data 

according to the method as claimed in any of Claims 1 to 8, and having means to display 
images processed according to said method, and possible means to store the image data. 

10. An X-ray apparatus having means for acquiring medical digital image data and 
15 having a system as claimed in claim 9 having access to said medical digital image data for 

processing said image data. 

11. A computer program product comprising a set of instruction for carrying out a 
method as claimed in one of claims 1 to 8. 
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ABSTRACT: 


The invention relates to an image processing method for noise filtering an 
image sequence representing a threadlike structure on a background, including an acquisition 
of point data in first and second sequence images and an estimation of the corresponding 
filtered point data for constructing a filtered second image, said method comprising, 
5 performed in each sequence image, steps of: 

extracting the threadlike structure points, forming strings from said extracted 
points, temporally filtering the data of the points located outside the strings denoted 
background points, spatially filtering the data of the string points, 

and constructing the filtered second image data by performing an insertion of 
10 the spatially filtered data of the string points into the temporally filtered data of the 
background points. 

In an application, the sequence images are X-ray fluoroscopic images 
representing a catheter guide-wire. The invention also relates to a system and an X-ray 
apparatus for carrying out the method. 
15 FIG.l. 
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